The crossed-hands deficit in temporal order judgments occurs for present, future, and past hand postures

When people judge the temporal order (TOJ task) of two tactile stimuli at the two hands while their hands are crossed, performance is much worse than with uncrossed hands [1]. This crossed-hands deficit is widely considered to indicate interferences of external spatial coordinates with body-centered coordinates in the localization of touch [2]. Similar deficits have also been observed when people are only about to move their hands towards a crossed position [3]-[5], suggesting a predictive update of external spatial coordinates. Here, we extend the investigation of the dynamics of external coordinates during hand movement. Participants performed a TOJ task while they executed an uncrossing or a crossing movement, and during presentation of the TOJ stimuli the present posture of the hands was crossed, uncrossed or in-between. Present, future and past crossed-hands postures decreased performance in the TOJ task, suggesting that the update of external spatial coordinates of touch includes both predictive processes and processes that preserve the recent past. In addition, our data corroborate the flip model of crossed-hands deficits [1], and suggest that more pronounced deficits come along with higher time requirements to resolve interferences

Memory influences haptic perception of softness

The memory of an object’s property (e.g. its typical colour) can affect its visual perception. We investigated whether memory of the softness of every-day objects influences their haptic perception. We produced bipartite silicone rubber stimuli: one half of the stimuli was covered with a layer of an object (sponge, wood, tennis ball, foam ball); the other half was uncovered silicone. Participants were not aware of the partition. They first used their bare finger to stroke laterally over the covering layer to recognize the well-known object and then indented the other half of the stimulus with a probe to compare its softness to that of an uncovered silicone stimulus. Across four experiments with different methods we showed that silicon stimuli covered with a layer of rather hard objects (tennis ball and wood) were perceived harder than the same silicon stimuli when being covered with a layer of rather soft objects (sponge and foam ball), indicating that haptic perception of softness is affected by memory

Effects of Stimulus Exploration Length and Time on the Integration of Information in Haptic Softness Discrimination

In haptic perception, information is often sampled serially (e.g., a stimulus is repeatedly indented to estimate its softness), requiring that sensory information is retained and integrated over time. Hence, integration of sequential information is likely affected by memory. Particularly, when two sequentially explored stimuli are compared, integration of information on the second stimulus might be determined by the fading representation of the first stimulus. We investigated how the exploration length of the first stimulus and a temporal delay affect contributions of sequentially gathered estimates of the second stimulus in haptic softness discrimination. Participants subsequently explored two silicon rubber stimuli by indenting the first stimulus one or five times and the second stimulus always three times. In an additional experiment, we introduced a 5-s delay after the first stimulus was indented five times. We show that the longer the first stimulus is explored, the more estimates of the second stimulus' softness contribute to the discrimination of the two stimuli, independent of the delay. This suggests that the exploration length of the first stimulus influences the strength of its representation, persisting at least for 5 s, and determines how much information about the second stimulus is exploited for the comparison

Deep neural network model of haptic saliency

Haptic exploration usually involves stereotypical systematic movements that are adapted to the task. Here we tested whether exploration movements are also driven by physical stimulus features. We designed haptic stimuli, whose surface relief varied locally in spatial frequency, height, orientation, and anisotropy. In Experiment 1, participants subsequently explored two stimuli in order to decide whether they were same or different. We trained a variational autoencoder to predict the spatial distribution of touch duration from the surface relief of the haptic stimuli. The model successfully predicted where participants touched the stimuli. It could also predict participants' touch distribution from the stimulus' surface relief when tested with two new groups of participants, who performed a different task (Exp. 2) or explored different stimuli (Exp. 3). We further generated a large number of virtual surface reliefs (uniformly expressing a certain combination of features) and correlated the model's responses with stimulus properties to understand the model's preferences in order to infer which stimulus features were preferentially touched by participants. Our results indicate that haptic exploratory behavior is to some extent driven by the physical features of the stimuli, with e.g. edge-like structures, vertical and horizontal patterns, and rough regions being explored in more detail

Integration of serial sensory information in haptic perception of softness.

Redundant estimates of an environmental property derived simultaneously from different senses or cues are typically integrated according to the maximum likelihood estimation model (MLE): Sensory estimates are weighted according to their reliabilities, maximizing the percept’s reliability. Mechanisms underlying the integration of sequentially derived estimates from one sense are less clear. Here we investigate the integration of serially sampled redundant information in softness perception. We developed a method to manipulate haptically perceived softness of silicone rubber stimuli during bare-finger exploration. We then manipulated softness estimates derived from single movement segments (indentations) in a multisegmented exploration to assess their contributions to the overall percept. Participants explored two stimuli in sequence, using 2–5 indentations, and reported which stimulus felt softer. Estimates of the first stimulus’s softness contributed to the judgments similarly, whereas for the second stimulus estimates from later compared to earlier indentations contributed less. In line with unequal weighting, the percept’s reliability increased with increasing exploration length less than was predicted by the MLE model. This pattern of results is well explained by assuming that the representation of the first stimulus fades when the second stimulus is explored, which fits with a neurophysiological model of perceptual decisions (Deco, Rolls, & Romo, 2010)

Active Haptic Exploration of Softness: Indentation Force Is Systematically Related to Prediction, Sensation and Motivation

Active finger movements play a crucial role in natural haptic perception. For the perception of different haptic properties people use different well-chosen movement schemes (Lederman and Klatzky, 1987). The haptic property of softness is stereotypically judged by repeatedly pressing one’s finger against an objects’ surface, actively indenting the object. It has been shown that people adjust the peak indentation forces of their pressing movements to the expected stimulus’ softness in order to improve perception (Kaim and Drewing, 2011). Here, we aim to clarify the mechanisms underlying such adjustments. We disentangle how people modulate executed peak indentation forces depending on predictive vs. sensory signals to softness, and investigate the influence of the participants’ motivational state on movement adjustments. In Experiment 1, participants performed a two alternative forced-choice (2AFC) softness discrimination task for stimulus pairs from one of four softness categories. We manipulated the predictability of the softness category. Either all stimuli of the same category were presented in a blocked fashion, which allowed predicting the softness category of the upcoming pair (predictive signals high), or stimuli from different categories were randomly intermixed, which made prediction impossible (predictive signals low). Sensory signals to softness category of the two stimuli in a pair are gathered during exploration. We contrasted the first indentation (sensory signals low) and last indentation (sensory signals high) in order to examine the effect of sensory signals. The results demonstrate that participants systematically apply lower forces when softer objects (as compared to harder objects) are indicated by predictive signals. Notably, sensory signals seemed to be not as relevant as predictive signals. However, in Experiment 2, we manipulated participant motivation by introducing rewards for good performance, and showed that the use of sensory information for movement adjustments can be fostered by high motivation. Overall, the present study demonstrates that exploratory movements are adjusted to the actual perceptual situation and that in the process of fine-tuning, closed- and open-loop mechanisms interact, with varying contributions depending on the observer’s motivation

Perception of Friction in Tactile Exploration of Micro-structured Rubber Samples

Fingertip friction and the related shear of skin are key mechanical mechanisms in tactile perception, but the perception of friction itself is rarely explored except for the flat surfaces of tactile displays. We investigated the perception of friction for tactile exploration of a unique set of samples whose fabric-like surfaces are equipped with regular arrays of flexible micropillars. The measured fingertip friction increases with decreasing bending stiffness, where the latter is controlled by radius (20–75 µm) and aspect ratio of the micropillars. In forced-choice tasks, participants noticed relative differences in friction as small as 0.2, and even smaller when a sample with less than 100 µm distance between pillars is omitted from the analysis. In an affective ranking of samples upon active touch, the perception of pleasantness is anticorrelated with the measured friction. Our results offer insights towards a rational design of materials with well-controlled surface microstructure which elicit a dedicated tactile appeal

Top-down modulation of shape and roughness discrimination in active touch by covert attention

Due to limitations in perceptual processing, information relevant to momentary task goals is selected from the vast amount of available sensory information by top-down mechanisms (e.g. attention) that can increase perceptual performance. We investigated how covert attention affects perception of 3D objects in active touch. In our experiment, participants simultaneously explored the shape and roughness of two objects in sequence, and were told afterwards to compare the two objects with regard to one of the two features. To direct the focus of covert attention to the different features we manipulated the expectation of a shape or roughness judgment by varying the frequency of trials for each task (20%, 50%, 80%), then we measured discrimination thresholds. We found higher discrimination thresholds for both shape and roughness perception when the task was unexpected, compared to the conditions in which the task was expected (or both tasks were expected equally). Our results suggest that active touch perception is modulated by expectations about the task. This implies that despite fundamental differences, active and passive touch are affected by feature selective covert attention in a similar way

Different contributions of efferent and reafferent feedback to sensorimotor temporal recalibration

Abstract: Adaptation to delays between actions and sensory feedback is important for efficiently interacting with our environment. Adaptation may rely on predictions of action-feedback pairing (motor-sensory component), or predictions of tactile-proprioceptive sensation from the action and sensory feedback of the action (inter-sensory component). Reliability of temporal information might differ across sensory feedback modalities (e.g. auditory or visual), which in turn influences adaptation. Here, we investigated the role of motor-sensory and inter-sensory components on sensorimotor temporal recalibration for motor-auditory (button press-tone) and motor-visual (button press-Gabor patch) events. In the adaptation phase of the experiment, action-feedback pairs were presented with systematic temporal delays (0 ms or 150 ms). In the subsequent test phase, audio/visual feedback of the action were presented with variable delays. The participants were then asked whether they detected a delay. To disentangle motor-sensory from inter-sensory component, we varied movements (active button press or passive depression of button) at adaptation and test. Our results suggest that motor-auditory recalibration is mainly driven by the motor-sensory component, whereas motor-visual recalibration is mainly driven by the inter-sensory component. Recalibration transferred from vision to audition, but not from audition to vision. These results indicate that motor-sensory and inter-sensory components contribute to recalibration in a modality-dependent manner

The Influence of Aging on Perceptual Grouping in Haptic Search

Perceptual grouping speeds up haptic search. This has particularly been shown for grouping of distractors by similarity and good continuation [1]. Here, we investigated the effect of aging on grouping in haptic search. We reasoned that because older adults have less cognitive resources available for processing perceptual information, they would benefit more from grouping as compared to younger adults. We tested this hypothesis in a haptic search task in which proximity, similarity and good continuation of the distractors were manipulated. We found that older adults indeed show a larger effect of distractor similarity on search times as compared to younger adults, where similar dis- tractors were processed faster than dissimilar distractors. However, older adults showed an opposite effect of grouping by proximity, where items that were further apart were processed faster. This may be caused by a strong bowed spatial position effect in older adults: stimuli that are closer to each other are more difficult to discriminate. We conclude that haptic perceptual grouping by similarity has larger benefits in elderly as compared to younger adults